Estimation of Hidden Markov Models for Partially Observed Risk Sensitive Control Problems
نویسندگان
چکیده
We look at the problem of estimation for partially observed risk sensitive control problems with nite state input and output sets and receding horizon We describe architectures for risk sensitive controllers and estimation and we state conditions under which both the estimated model converges to the true model and the control policy will converge to the optimal risk sensitive policy
منابع مشابه
Estimation of hidden Markov models for a partially observed risk sensitive control problem
This paper provides a summary of our recent work on the problem of combined estimation and control of systems described by finite state, hidden Markov models. We establish the stochastic framework for the problem, formulate a separated control policy with risksensitive cost functional, describe an estimation scheme for the parameters of the hidden Markov model that describes the plant, and fina...
متن کاملAnalysis of a Risk Sensitive Control
Recently considerable attention has been given to the study of risk-sensitive stochasic control problems 1]-13]. Risk-sensitive control is a generalization of the risk-neutral approach, in which we seek to minimize an exponential of the sum of costs. In particular, there has been work on risk-sensitive Markov Decision Processes (MDPs) { i.e., discrete-time problems with a nite or countable stat...
متن کاملEstimation of hidden markov models: risk-sensitive filter banks and qualitative analysis of their sample paths
A sequential filtering scheme for the risk-sensitive state estimation of partially observed Markov chains is presented. The previously introduced risk-sensitive filters are unified in the context of risk-sensitive maximum a posterior probability estimation. Structural results for the filter banks are given. The influence of the availability of information and the transition probabilities on the...
متن کاملRobust and Risk-Sensitive Output Feedback Control for Finite State Machines and Hidden Markov Models
The purpose of this paper is to develop a framework for designing controllers for finite state systems which are robust with respect to uncertainties. A deterministic model for uncertainties is introduced, leading to a dynamic game formulation of the robust control problem. This problem is solved using an appropriate information state. A risk-sensitive stochastic control problem is formulated a...
متن کاملInverse Problems in Imaging Systems and the General Bayesian Inversion Frawework
In this paper, first a great number of inverse problems which arise in instrumentation, in computer imaging systems and in computer vision are presented. Then a common general forward modeling for them is given and the corresponding inversion problem is presented. Then, after showing the inadequacy of the classical analytical and least square methods for these ill posed inverse problems, a Baye...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1997